Validating Bundled Gap Filling – Empirical Evidence for Ambiguity Reduction and Language Proficiency Testing Capabilities

نویسندگان

  • Niklas Meyer
  • Michael Wojatzki
  • Torsten Zesch
چکیده

Bundled gap filling exercises (Wojatzki et al., 2016) were recently introduced as a promising new exercise type to complement or even replace single gap-fill tasks. However, it is not yet confirmed that the applied creation method works properly and it is still to be investigated if bundled gap-fill tests are a suitable method for assessing language proficiency. In this paper, we address both issues by varying the construction methods and by conducting a user study with 75 participants in which we also measure externally validated language proficiency. We find that the originally proposed way to construct bundles is indeed minimizing their ambiguity, but that further investigation is needed to determine which aspects of language proficiency they are actually measuring.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Bundled Gap Filling: A New Paradigm for Unambiguous Cloze Exercises

Cloze tests, also known as gap-fill exercises, are a popular tool for acquiring and evaluating language proficiency. A major challenge in the way of automating scoring of cloze tests is the yet unsolved problem of gap filler ambiguity. To address this challenge, we present the concept of bundled gap filling, along with (1) an efficient computational model for automatically generating unambiguou...

متن کامل

Establishing an Argument-Based Validity Approach for a Low-Stake Test of Collocational Behavior

Most of the validation studies conducted across varying test application contexts are usually framed within the traditional conceptualization of validity and therefore lack a comprehensive framework to focus on test score interpretations and test score use. This study aimed at developing and validating a collocational behavior test (CBT), drawing on Kane's argument-based approach to validity. F...

متن کامل

Assessing Pragmatics through MDCTs: A Case of Iranian EFL Learners

Testing pragmatic competence has always posed daunting challenges to researchers and practitioners. As a step to address the gap in pragmatic testing, this paper delineates the procedural stages of developing and validating a context-sensitive Multiple Choice Discourse Completion Test (MDCT). Following a unitary view of validity, tenable argument and empirical evidence was accumulated to suppor...

متن کامل

Test Method Facet and the Construct Validity of Listening Comprehension Tests

The assessment of listening abilities is one of the least understood, least developed and, yet, one of the most important areas of language testing and assessment. It is particularly important because of its potential wash-back effects on classroom practices. Given the fact that listening tests play a great role in assessing the language proficiency of students, they are expected to enjoy a hig...

متن کامل

Ambiguity Theory and Asset Pricing: Empirical Evidence from Tehran Stock Exchange

Modern portfolio theory is based on the relationship between risk and return and in this paper, specific uncertainty conditions are introduced as ambiguity which affects the asset pricing. Also, the relationship between risk, ambiguity and return is examined. First, ambiguity is estimated by the means of three-variable and main component method, trading volume, ask-bid spread, error of earnings...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016